Hopfield neural network: The hyperbolic tangent and the piecewise-linear activation functions

نویسندگان

  • Amanda C. Mathias
  • Paulo C. Rech
چکیده

This paper reports two-dimensional parameter-space plots for both, the hyperbolic tangent and the piecewise-linear neuron activation functions of a three-dimensional Hopfield neural network. The plots obtained using both neuron activation functions are compared, and we show that similar features are present on them. The occurrence of self-organized periodic structures embedded in chaotic regions is verified for the two cases.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Accelerating Activation Function for 3- Satisfiability Logic Programming

This paper presents the technique for accelerating 3-Sat isfiability (3-SAT) logic programming in Hopfield neural network. The core impetus for this work is to integrate activation function for doing 3-SAT logic programming in Hopfield neural network as a single hybrid network. In logic programming, the activation function can be used as a dynamic post optimizat ion paradigm to transform the ac...

متن کامل

Effects of Non-uniform Suction, Heat Generation/Absorption and Chemical Reaction with Activation Energy on MHD Falkner-Skan Flow of Tangent Hyperbolic Nanofluid over a Stretching/Shrinking Eedge

In the present investigation, the magnetohydrodynamic Falkner-Skan flow of tangent hyperbolic nanofluids over a stretching/shrinking wedge with variable suction, internal heat generation/absorption and chemical reaction with activation energy have been scrutinized. Nanofluid model is composed of “Brownian motion’’ and “Thermophoresis’’. Transformed non-dimensional coupled non-linear equations a...

متن کامل

Training of Perceptron Neural Network Using Piecewise Linear Activation Function

A new Perceptron training algorithm is presented, which employs the piecewise linear activation function and the sum of squared differences error function over the entire training set. The most commonly used activation functions are continuously differentiable such as the logistic sigmoid function, the hyperbolic-tangent and the arctangent. The differentiable activation functions allow gradient...

متن کامل

Multistability and instability of delayed competitive neural networks with nondecreasing piecewise linear activation functions

In this paper, we investigate the exact existence and dynamical behaviors of multiple equilibrium points for delayed competitive neural networks (DCNNs) with a class of nondecreasing piecewise linear activation functions with 2rðr≥1Þ corner points. It is shown that under some conditions, the N-neuron DCNNs can have and only have ð2r þ 1Þ equilibrium points, ðr þ 1Þ of which are locally exponent...

متن کامل

Corruption of Generalizing Signals in Densely Connected Feedforward Neural Networks with Hyperbolic Tangent Activation Functions

This paper discusses the propagation of signals in generic densely connected multilayered feedforward neural networks. It is concluded that the dense connecting combined with the hyperbolic tangent activation functions of the neurons may cause a highly random, spurious generalization, that decreases the overall performance and reliability of a neural network and can be mistaken with overfitting...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Neural networks : the official journal of the International Neural Network Society

دوره 34  شماره 

صفحات  -

تاریخ انتشار 2012